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Abstract 

We analyze the asymptotic behavior of sequences of random variables 
( x ( n ))n£N defined by an initial condition and the induction formula Xi(n + 
1) = maxj (Ay(n) + Xj(ri)), where (A(n)) neIsi is a stationary and ergodic 
sequence of random matrices with entries in KU {— oo}. 

This type of recursive sequences are frequently used in applied proba- 
bility as they model many systems as some queueing networks, train and 
computer networks, and production systems. 

We give a necessary condition for (ix(n)) ngN to converge almost- 
surely, which proves to be sufficient when the A(n) are i.i.d. 

Moreover, we construct a new example, in which (A(n)) jieN is strongly 
mixing, that condition is satisfied, but (^ a; ( n )) nCN does not converge 
almost-surely. 
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1 Introduction 



1.1 Model 

We analyze the asymptotic behavior of the sequence of random variables (x(n, xo))„ eN 
defined by: 

f x(0,xo) = x /.x 

\ Xi(n +l,xo) = maxj (Aij(n) + Xj(n,Xo)) ' 

where (A(n)) ngN is a stationary and ergodic sequence of random matrices with entries 
in R U {— oo}. Moreover, we assume that A(n) has at least one finite entry on each 
row, which is a necessary and sufficient condition for x(n, xq) to be finite. (Otherwise, 
some coefficients can be — oo.) 

Such sequences are best understood by introducing the so-called max-plus algebra, 
which is actually a semiring. 

Definition 1.1. The max-plus semiring R max is the set tU {— oo}, with the max as 
a sum (i.e. a © b = max(a, b)) and the usual sum as a product (i.e. a (8> b = a + b). In 
this semiring, the identity elements are — oo and 0. 

We also use the matrix and vector operations induced by the semiring structure. 
For matrices A, B with appropriate 

(A (8 B) i:j = fc A lk ® B kj = ma,x k (A ik + B kj ), and for a scalar a 6 R max , (a ® A) y = 
a eg) Ay = a + Ay. Now, Equation (1) x(n + 1, aso) ® A(n)x(n, xo). In the sequel, all 
products of matrices by vectors or other matrices are to be understood in this structure. 

For any integer k > n, we define the product of matrices A{k,n) :— A(k) ■ ■ ■ A(n) 
with entries in this semiring. Therefore, we have x(n, Xo) = A(n — 1,0)xq and if the 
sequence has indices in Z, which is possible up to a change of probability space, we 
define a new random vector y(n, Xo) := A(— 1, — n)xo, which has the same distribution 
as x(n, xo). 

Sequences defined by Equation I model a large class of discrete event dynami- 
cal systems. This class includes some models of operations research like timed event 
graphs (F. Baccelli [1]), 1-bounded Petri nets (S. Gaubert and J. Mairesse [10]) and 
some queuing networks (J. Mairesse [15], B. Heidergott [12]) as well as many con- 
crete applications. Let us cite job-shops models (G. Cohen et al.[7]), train networks 
(H. Braker [6], A. de Kort and B. Heidergott [9]), computer networks (F. Baccelli and 
D. Hong [3]) or a statistical mechanics model (R. Griffiths [11]). For more details about 
modelling, see the books by F. Baccelli and al. [2] and by B. Heidergott and al. [13]. 

1.2 Law of large numbers 

The sequences satisfying Equation (1) have been studied in many papers. If a matrix 
A has at least one finite entry on each row, then x i— > Ax is non-expanding for the L°° 
norm. Therefore, we can assume that xq is the 0- vector, also denoted by 0, and we do 
it from now on. 

We say that (x(n, 0)) TlgN defined in (1) satisfies the strong law of large numbers 
if (ix(n, 0)) ngN converges almost surely. When it exists, the limit in the law of large 
numbers is called the cycle time of (A(n)) ngN or (x(n,0)) ngN , and may in principle 
be a random variable. Therefore, we say that (A(n)) ngN has a cycle time rather than 
(x(n,0)) ngN satisfies the strong law of large numbers. 

Some sufficient conditions for the existence of this cycle time were given by J.E. Co- 
hen [8] , F. Baccelli and Liu [4, 1] , Hong [14] and more recently by Bousch and Mairesse [5] , 
the author [16] or Heidergott et al. [13]. 
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Bousch and Mairesse proved (Cf. [5]) that, if ^4(0)0 is integrable, then the se- 
quence (-^y(n, 0)) ngN converges almost-surely and in mean and that, under stronger 
integrability conditions, (— a;(n, 0)) ngN converges almost-surely if and only if the limit 
of (^y(n, 0)) ngN is deterministic. The previous results can be seen as providing suffi- 
cient conditions for this to happen. Some results only assumed ergodicity of (A(n)) n ^, 
some others independence. But, even in the i.i.d. case, it was still unknown, which 
sequences had a cycle time and which had none. 

In this paper, we solve this long standing problem. The main result (Theorem 2.4) 
establishes a necessary and sufficient condition for the existence of the cycle time of 
(A(n)) n6N . Moreover, we show that this condition is necessary (Theorem 2.3) but not 
sufficient (Example 1) when {A(n)) nGti is only ergodic or mixing. Theorem 2.3 also 
states that the cycle time is always given by a formula (Formula (3)), which was proved 
in Baccelli [1] under several additional conditions. 

To state the necessary and sufficient condition, we extend the notion of graph of a 
random matrix from the fixed support case, that is when the entries are either almost- 
surely finite or almost-surely equal to — oo, to the general case. The analysis of its 
decomposition into strongly connected components allows us to define new submatrices, 
which must have almost-surely at least one finite entry on each row, for the cycle time 
to exist. 

To prove the necessity of the condition, we use the convergence results of Bousch 
and Mairesse [5] and a result of Baccelli [1]. To prove the converse part of Theorem 2.4, 
we perform an induction on the number of strongly connected components of the graph. 
The first step of the induction (Theorem 3.11) is an extension of a result of D. Hong [14]. 

The paper is organized as follows. In Section 2, we state our results and give 
examples to show that the hypotheses are necessary. In Section 3, we successively 
prove Theorem 2.3 and Theorem 2.4 

2 Results 
2.1 Theorems 

In this section we attach a graph to our sequence of random matrices, in order to define 
the necessary condition and to split the problem for the inductive proof of the converse 
theorem. 

Before defining the graph, we need the following result, which directly follows from 
Kingman's theorem and goes back to J.E. Cohen [8]: 

Theorem-Definition 2.1 (Maximal Lyapunov exponent). 

If (A(n)) neti is an ergodic sequence of random matrices with entries in K max such that 
the positive part o/maxy Aij(0) is integrable, then the sequences (i max^ Xi(n, 0)) neN 
and (i maxj j/i(n, 0)) neN converge almost-surely to the sciuic constant **y £ IK-max; 

which 

is called the maximal (or top) Lyapunov exponent o/(A(n)) ngN . 
We denote this constant by 7 ((A(n)) ngN ) , or j(A). 

Remarks 2.1. 

1. The constant j(A) is well-defined even if (A(n)) neN has a row without finite 
entry. 
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2. The variables max^ Xi(n, 0) and max^ yi(n, 0) are equal to max !3 A(n — 1, 0)jj and 
maxij A{— 1, —n)ij respectively. 

Let us define the graph attached to our sequence of random matrices as well as 
some subgraphs. We also set the notations for the rest of the text. 

Definition 2.2 (Graph of a random matrix). For every x £ Rmkx an d every subset 
/ C [1, • ■ • , d], we define the subvector x 1 := (xi)i e j. 

Let (A(n)) ngN be a stationary sequence of random matrices with values in R^ax- 

i) The graph of (A(n)) neN , denoted by G(A), is the directed graph whose nodes 
are the integers between 1 and d and whose arcs are the pairs (i, j) such that 

P(Ay(0) £ -00) > 0. 

ii) To each strongly connected component (s.c.c) c of <?(^4), we attach the submatrices 

:= (Ai J -(n))i, J - ec and the exponent := 7 (A< C )). 

Nodes which are not in a circuit are assumed to be alone in their s.c.c Those s.c.c 
are called trivial and they satisfy A^ = —00 a.s. and therefore 7^ = —00. 

iii) A s.c.c c is reachable from a s.c.c c (resp. from a node i) if c = c (resp. i £ c) or if 
there exists a path on Q{A) from a node in c (resp. from i) to a node in c. In this 
case, we write c — > c. (resp. i — ► c). 

iv) To each s.c.c. c, we associate the set {c} constructed as follows. First, one finds all 
s.c.c. downstream of c with maximal Lyapunov exponent. Let C be their union. 
Then the set {c} consists of all nodes between c and C: 



which can be read as 'A(fc, k — n)ij is the maximum of the weights of paths from 
i to j with length n on G(A), the weight of the I th arc being given by A(k — /)'. 
For k = —1, it implies that j/i(n,0) is the maximum of the weights of paths on 
G(A) with initial node i and length n but 7(A) is not really the maximal average 
weight of infinite paths, because the average is a limit and maximum is taken 
over finite paths, before the limit over n. However, Theorem 3.3, due to Baccelli 
and Liu [1, 4], shows that the maximum and the limit can be exchanged. 

2. Previous author used such a graph, in the fixed support case, that is when 
-P(yLj(0) = —00) 6 {0,1}. In that case, the (random) weights where almost 
surely finite. Here, we can have weights equal to —00, but only with probability 
strictly less than one. 

3. In the literature, the isomorphic graph with weight Aji on arc is often used, 
although only in the fixed support case. This is natural in order to multiply 
vectors on their left an compute x(n, 0). Since we mainly work with y(n, 0) and 
thus multiply matrice on their right, our definition is more convenient. 

With those definitions, we can state the announced necessary condition for (x(n, Xq)) 
to satisfy a strong law of large numbers: 




Remark 2.2 (Paths on Q{A)). 

1. The products of matrices satisfy the following equation: 



n-l 




max 
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Theorem 2.3. Let (A(n)) ngN be a stationary and ergodic sequence of random matrices 
with values in R^ax an d almost- surely at least one finite entry on each row, such that 
the positive part of max y - A^ (0) is integrable. 

1. If the limit of (iy(n, 0)) N is deterministic, then it is given by: 

Vi G [1, <f],lim— yAn, 0) = max7' c ' a.s., (2) 

n n i— >c 

That being the case, for every s.c.c c of Q{A), the submatrix of A(0) whose 
indices are in {c} almost-surely has at least one finite entry on each row. 

2. If (^x(n, 0)) ngN converges almost-surely, then its limit is deterministic and is 
equal to that of (iy(n, 0)) ngN , that is we have: 

Vi G [1, d], lira — xAn, 0) = max7' c ' a.s., (3) 

n 71 i— >c 

To make the submatrices A^ more concrete, we give on Fig. 1 an example of a 
graph G(A) with the exponent 7W attached to each s.c.c and we compute {02}. 
The maximal Lyapunov exponent of s.c.c. downstream of C2, is 7^. The only s.c.c. 
downstream of C2 with this Lyapunov exponent is C5 and the only s.c.c. between C2 
and C5 is C3. Therefore, {02} is the union of C2, C3 and C5. 




The necessary and sufficient condition in the i.i.d. case reads 

Theorem 2.4 (Independent case). If (A(n)) n ^ is a sequence of i.i.d. random matrices 
with values in K^ax an d almost-surely at least one finite entry on each row, such that 
max (0)^-00 (0)| is integrable, then the sequence (^i(n, 0)) converges almost- 
surely if and only if for every s.c.c c, the submatrix A* c } of A(0) defined in Theorem 2.3 
almost-surely has at least one finite entry on each row. That being the case the limit is 
given by Equation (3). 

Remark 2.3. We also prove that, when .4(0)0 G L 1 , the limit of (iy(n, 0)) is deter- 
ministic if and only if the matrices A^ almost-surely have at least one finite entry on 
each row. 
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The stronger integrability ensures the convergence of (jrx(n, 0)) to this limit, like 
in [5, Theorem 6.18]. There, it appeared as the specialization of a general condition 
for uniformly topical operators, whereas in this paper it ensures that BO is integrable 
for every submatrix B of A(0) with at least one finite entry on each row. 

Actually, we prove that (j-x(n, 0)) converges, provided that \/c,A^0 £ L 1 , (see 
Proposition 3.5). We chose to give a slightly stronger integrability condition, which is 
easier to check because it does not depend on Q{A). 

2.2 Examples 

To end this section, below are three examples that show that the independence is 
necessary but not sufficient to ensure the strong law of large numbers and that the 
integrability condition is necessary. We will denote by x T the transpose of a vector x. 

Example 1 (Independence is necessary). Let A and B be defined by 

"-(-» T)™ dB = (T -!)• 

For any positive numbers 71 and 72 such that 71+72 < 1, we set 5 = 1 _ 
(A(n), i n )nefi be a stationnary version of the irreducible Markov chain on {A, B} x{l, 2} 
with transition probabilities given by the diagram of Figure 2: 



Fi gure 2: Transition probabilities of (A(ji),i n ) n ^ 



1 - S 




1-5 



Then, (A(n)) ngN is a strongly mixing sequence of matrices, which means that it 
satisfies 

E [/ (A(0)) g (A(n))} — > E [/ (A(0))] E [/ (A(0))] 



for any integrable functions /and g on 
{A, B} N , but we have 



pdxd 



Moreover, its support is the full shift 



lim -yi(n,0) = 71 ) = 71 + S and P (lim —yi(n, 0) = 72 ] = 72 + S, (4) 

n n J \ n n J 

and thus, according to Theorem 2.3, (^-x(n, 0)) ngN does not converge. Finally, even if 
(A(n)) n( - N is a quickly mixing sequence, which means that it is in some sense close to 
i.i.d. , and Q{A) is strongly connected, does (A(n)) neN fail to have a cycle time. 

To prove Equation (4) , let us denote by r the permutation between 1 and 2 and by 
g(C, i) the only finite entry on the i th row of C . It means that for any i, g(A, i) = An 
and g(B, i) — B iT ^y Since all arcs of the diagram arriving to a node (^4, i) are coming 
from a node (C, i), while those arriving at a node (B, i) are coming from a node (C, r(i)), 
we almost surely have 



Xi n (n+l,0)-x ln __ 1 (n,0) = g(A(n),i n )) and x T(in) {n+l,0)-x T(in l) (n,0) = g(A(n),T(i n ))), 
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and thus 



n-l 



x i n -i( n i°) = ^2g(A(k),ik) and x T(i „_ l) (n, 0) = ^ g(A(k), r(i k )), 

k=0 k=0 
n n 

Vi_ x {n,Q) = ^2g(A(-k),i-k) and J/ T (t_i)(n,0) = ^2g(A(-k),T(i- k ))- 



fc=i 



fc=i 



It is easily checked that the invariant distribution of the Markov chain is given by 
the following table: 



X 


(Ai) 


(5,2) 


(A,2) 


(5,1) 


P((A(n), in) = as) 


7i 


5 


72 


<5 



and that g is equal to except in (A, 1). 
Therefore, we have 



\im-y i _ 1 (n,0) 

n n 

lim-y r(i _ 1 )(n,0) 
and consequently 



E ( 5 (A(0), to)) = P ((A(0), io) = (A, 1)) = 7i 

E (.g(A(0), r(i ))) = P ((A(0), r(i )) = (A, 2)) = 72 

1 



lim-y(n,0) = (7 i _ 1 ,7 T (i_ l) ) a.s. 

n n 

which implies Equation (4). 

The next example, due to Bousch and Mairesse shows that the cycle time may not 
exist, even if the A(n) are i.i.d. 

Example 2 (Bousch and Mairesse, Independence is not sufficient). Let (A(n)) neN be 
the sequence of i.i.d. random variables taking values 



B = 




and C 



— oo — oo 
-oo 
-oo 



with probabilities p > and 1 — p > 0. Let us compute the action of B and C on 
vectors of type (0, x, y) T , with x, y > 0: 

B(Q, x, y) T = (0, 0, max(a;, y) + 1) T and C(0, x, y) T = (0, y, x) T . 

Therefore Xx(n, 0) = and maxjXj(n + 1,0) = #{0 < k < n\A(k) — B}. In par- 
ticular, if A(n) = B, then x(n + 1,0) = (0,0, #{0 < k < n\A(k) = B}) T , and if 
A(n) = C and A(n - 1) = B, then + 1,0) = (0, #{0 < k < n\A(k) = 5},0) T . 
Since (^-#{0 < k < n\A(k) — 5}) ngN converges almost-surely to p, we arrive at: 



lim„ ~a;i(rc,0) = a.s. 
Vi G {2, 3}, liminf n -^Xi(n, 0) = and limsup n —Xi(n, 0) = p a.s. 

Therefore the sequence (— aj(n, 0)) n „ almost-surely does not converge. 



(5) 



We notice that 5(A) has two s.c.c ci = {1} and C2 = {2,3}, with Lyapunov 
exponents 7( C1 ) = and — p, and 2 — * 1. Therefore, we check that the first row 
of A^ C2 ^ has no finite entry with probability p. 
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Theorem 2.4 gives a necessary and sufficient condition for the existence of the 
cycle time of an i.i.d. sequence of matrices A(n) such that max^..(o)^_oo l^kj'(0)| is 
integrable. But the limit of (^y(n,0)) n£f!j exists as soon as A(0)0 is integrable. Thus, 
it would be natural to expect Theorem 2.4 to hold under this weaker integrability 
assumption. However, it does not, as the example below shows. 

Example 3 (Integrability). Let (A„) neZ be an i.i.d. sequence of real variables satisfying 
X n > 1 a.s. and K(X n ) — +oo. The sequence of matrices is defined by: 

/ -X n -X n \ 
A{n) = -co 

y — oo — oo —1 I 

A straightforward computation shows that x(n, 0) is (max(— X n , — n), 0, — n) T and 
y(n,Q) = (max(— Xq, — n), 0, — n) T . It follows from Borel-Cantelli lemma that lim„ -^X n = 
a.s. if and only if E(X n ) < oo. Hence [^x(n, 0)) neN converges to (0,0, —1) T in prob- 
ability but the convergence does not occur almost-surely. 

Let us notice that the limit of (^y(n, 0)) ngN is given by Remark 2.3: each s.c.c has 
exactly one node, 7W = — E(X„) = -00, 7^ = and 7^ = -1. 

3 Proofs 

3.1 Necessary conditions 
3.1.1 Additional notations 

To interpret the results in terms of paths on G(A), and prove them, we redefine the 
A< c > and some intermediate submatrices. 

Definition 3.1. To each s.c.c c, we attach three sets of elements. 

i) Those that only depend on c itself. 

x^(n,xo) :=4 (c) (n-l,0)(3;o) c and y {c) (n,x ) := A^{-l,-n)(x ) c 

ii) Those that depend on the graph downstream of c. 

E c := {c\c — > c}, 7^ := max7^, 

c£B c 

F c := |J c, A^(n) := (A^n))^ 

ceE a 

x^(n,x ) := A^(n- l,Q){x ) F - and y [c] (n, x ) := A® (-1, -n){x ) Fc . 

iii) Those that depend on {c}, as defined in Definition 2.2. 

G c := {5 G E c \3c, c - 5 - c, 7 (£) = 7 [c] }, 
H c := |J c,A^(n):=(A tJ (n)) ijeHc 

x^(n,x ) := A^(n- l,0)(xa) Ha and y^(n,x ) := A< c >(-1, -n){x ) H '. 

iv) A s.c.c c is called dominating if G c = {c}, that is if for every c S E c \{c\, we have: 
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With those notations, the {c} of Definition 2.2 is denoted by H c , while 
is A-f c >(0). 

As in Remark 2.2, we notice that the coefficients y\ (n, 0), yf\ n , 0) and y\°^[n, 0) 
are the maximum of the weights of paths on the subgraph of Q(A) with nodes in c, F c 
and H c respectively. 

Consequently "/(A^) and 'y(A^) are the maximal average weight of infinite 
paths on c, F c and G c respectively. Since 7^ is the maximum of the 7*- c ) for s.c.c c 
downstream of c, the interpretation suggests it might be equal to j(A^) and ^(A^). 
That this is indeed true has been shown by F. Baccelli [1]. 

Clearly, 'y(A^) > ^(A^) > ^(A^), but the maximum is actually taken for finite 
paths, so that the converse inequalities are not obvious. 

3.1.2 Formula for the limit 

Up to a change of probability space, we can assume that A(n) — A o n , where A is 
a random variable and (f2, 8, P) is an invertible ergodic measurable dynamical system. 
We do it from now on. 

Let L be the limit of (iy(n, 0)) N , which exists according to [5, Theorem 6.7] and 
is assumed to be deterministic. 

By definition of Q(A), if is an arc of Q(A), then, with positive probability, we 
have Aij(— 1) ^ —00 and 

L t = lim-2/i(n,0) > lim -{A i3 (-1) + yj(n, 0) o O^ 1 ) = + Lj o 6» _1 = L r 

n jl n fi 

If c — ► c, then for every i £ c and j 6 c, there exists a path on G(A) from i to j, 
therefore Li > Lj. Since this holds for every j £ F c , we have: 

Li = max Lj (6) 

To show that max Jg p c Lj — we have to study the Lyapunov exponents of sub- 
matrices. 

The following proposition states some easy consequences of Definition 3.1 which 
will be useful in the sequel. 

Proposition 3.2. The notations are those of Definition 3.1 
i) For every s.c.c. c, x^(n, xo) — x Fc (n,xo). 
ii) For every s.c.c. m, and every i £ c, we have: 

Xi(n,0) = x [ f- ] (n, 0) > x\ c] (n, 0) > x[ c} (n, 0). 

W (n,0) = 2/j c] (n,0) > y\ c] (n,0) > y^(n,0). (7) 
Hi) Relation — > is a partial order, for both the nodes and the s.c.c. 

iv) If A(0) has almost- surely at least one finite entry on each row, then for every s.c.c. 
c, A^ (0) has almost- surely has least one finite entry on each row. 

v) For every c 6 E c> we have 7^ < 7^ < 7^' and G c = {c G -E c |7' c ' = 7' c '}. 

The next result is about Lyapunov exponents. It is already in [1, 4] and its proof 
does not uses the additional hypotheses of those articles. For a point by point checking, 
see [16]. 



9 



Theorem 3.3 (F. Baccelli and Z. Liu [1, 4, 2]). If (A(n)) neN is a stationary and 
ergodic sequence of random matrices with values in K^ax such that the positive part of 
maxjj Aij is integrable, then j(A) — max c 7^ c ^. 

Applying this theorem to sequences (A' c ' i n )) neN an d (^ c ^( n ))„ £ N' we § et ^ e 
following corollary. 

Corollary 3.4. For every s.c.c. c, we have 

It follows from Proposition 3.2 and the definition of Lyapunov exponents that for 
every s.c.c c of Q(A), 

max Li = lim — maxyAn, 0) = ^(A^). 

i£F c n n i£F c 

Combining this with Equation (6) and Corollary 3.4, we deduce that the limit of 
(^2/( n > ))„ eN is S iven h y Equation (2). 

3.1.3 A^(0) has at least one finite entry on each row 

We still have to show that for every s.c.c c, A^(0) almost-surely has at least one finite 
entry on each row. Let us assume it has none. It means that there exists a s.c.c. c and 
an i G c such that the set 

{Vj S ff c ,^y(-l) = -00} 

has positive probability. On this set, we have: 

Vi(n, 0) < max Aaa(— 1) + max yAn — 1, 0) o 

Dividing by n and letting n to +oo, we have Lj < max je jr,\ h c Lj- Replacing L ac- 
cording to Equation (2) we get 7^ < maxf : g£ c yg c 7^]. This last inequality contradicts 
Proposition 3.2 v). Therefore, A^(0) has almost-surely at least one finite entry on 
each row. 

3.1.4 The limit is deterministic 

Let us assume that (~x(n, 0)) N converges almost-surely to a limit V . 

It follows from [5, Theorem 6.7] that (^l/( n )0))„ gN converges almost-surely, thus 
we have 

ly(n,0)-— j— y(n + 1,0)^0. 
n n + 1 

We compound each term of this relation by 9 n+1 and, since x(n,0) = y(n,0) o 9 n , it 
proves that: 

1 1 p 
-x(n, 0)o 9 x(n + 1, 0) A 0. 

When n tends to +00, it becomes L' o 9 — L 1 = 0. Since 9 is ergodic, this implies that 
L' is deterministic. 

Since ^y(n, 0) = -^x(n, 0) o 9 n , L' and L have the same law. Since L' is determin- 
istic, L = L' almost-surely, therefore L is also the limit of (ix(n, 0)) n£N . This proves 
formula (3) and concludes the proof of Theorem 2.3 
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3.2 Sufficient conditions 
3.2.1 Right products 

In this section, we prove the following proposition, which is a converse to Theorem 2.3. 
In the sequel, 1 will denote the vector all coordinates of which are equal to 1. 

Proposition 3.5. Let (A(n)) ngN be an ergodic sequence of random matrices with values 
in sucn that the positive part of max^ Aij (0) is integrahle and that the three 

following hypotheses are satisfied: 

1. For every s.c.c c of Q(A), (0) almost-surely has at least one finite entry on 
each row. 

2. For every dominating s.c.c c of Q{A), lim ra j-y(°'(n,Q) — 7^1 a.s. 

3. For every subsets I and J of [1, ••• ,d\, such that random matrices A(n) = 
(Aij(n)) i j eluj almost-surely have at least one finite entry on each row and split 
along I and J following the equation 

- ( $> ) ' (8 > 

such that G{B) is strongly connected and D(n) is not almost-surely (— oo) Iy J , 
we have: 

F({3i e 7,Vn e N, (£?(— 1) ■■■B(-n)D(-n-l)0) i = -co}) = 0. (9) 

Then the limit of (~y(n, 0)) n£N is given by Equation (2). 

If Hypothesis 1. is strengthened by demanding that A^ (0)0 is integrahle, then the 
sequence (^x(n, 0)) neN converges almost-surely and its limit is given by Equation (3). 

Hypothesis 1. is necessary according to Theorem 2.3, Hypothesis 2 ensures the 
basis of the inductive proof, while Hypothesis 3 ensures the inductive step. 

Remark 3.1 (Non independent case). Proposition 3.5 does not assume the independence 
of the A(n). Actually, it also implies that \J^x(n, 0)) nj _ N almost surely if the A(n) have 
fixed support (that is P(Aij(n) — — oo) G {0,1}) and the powers of the shift are 
ergodic, which is an improvement of [1]. It also allows to prove the convergence when 
the diagonal entries of the A(n) are almost surely finite, under weaker integrability 
conditions than in [5] (see [17] or [16] for details). 

Remark 3.2 (Paths on G(A), continued). Let us interpret the three hypotheses with 
the paths on G(A). 

1. The hypothesis on A^ (0) means that, whatever the initial condition ! 6 c, there 
is always an infinite path beginning in i and not leaving H c . 

2. The hypothesis on dominating s.c.c means that, whatever the initial condition i 
in a dominating s.c.c c, there is always a path beginning in i with average weight 
j( c \ The proof of Theorem 3.3 (see [1] or [16]) can be adapted to show that it 
is a necessary condition. 

3. We will use the last hypothesis with A(n) = A^(n), B(n) = A^ c \n). It means 
that there is a path from i e c, to H c \c. Once we know that the limit of 
(iy(n, 0)) ngN is given by Equation (2) this hypothesis is obviously necessary 
when 7^ < 7W. 
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The remainder of this subsection is devoted to the proof of Proposition 3.5. It 
follows from Propositions 3.2 and 3.4 and the definition of Lyapunov exponents that 
we have, for every s.c.c c of 0(A), 

lim sup - y c (n, 0) < j [c] 1 a.s. (10) 

n 71 

Therefore, it is sufficient to show that liminf„ iy c (n, 0) > 7^1 a.s. Because of 
Proposition 3.2 i), 

lim-y^(n,0) = 7^1. (11) 

n n 

is a stronger statement. We prove Equation (11) by induction on the size of G c . The 
initialization of the induction is exactly Hypothesis 2. of Proposition 3.5. 

Let us assume that Equation (11) is satisfied by every c such that the size of G c 
is less than N, and let c be such that the size of G c is N + 1. Let us take I = c 
and J — H c \c. If c is not trivial, it is the situation of Hypothesis 3. with A = A^ c \ 
which almost-surely has at least one finite entry on each row thanks to Hypothesis 1. 
Therefore, Equation (9) is satisfied. If c is trivial, G(B) is not strongly connected, but 
Equation (9) is still satisfied because D(-1)0 = (i(-l)O) 7 G M. 1 . 

Moreover, J is the union of the c such that c G G c \{c}, thus the induction hypoth- 
esis implies that: 

Vj G J,j G c lim - (C(-l, -n)0), = lim -yf } (n, 0) = 7 [£] a.s.. 

n XI n 71 

Because of Corollary 3.4 ii), 7M = therefore the right side of the last equation is 
7^1 and we have: 

limi(2/ {c} ) J (n,0) =lim-C(-l,-n)0 = 7 [c] l a.s.. (12) 

n n n n 

Equation (9) ensures that, for every i £ I, there exists almost-surely a T G N and a 
j G J such that (B(-1,-T)D(-T - ^ -00. Since we have lim„ i (C (-T , -n)Q) 5 = 
7l c l a.s., it implies that: 

lim inf — yj c ^ (n, 0) 

n n 

> lim - (B(-l, -T)D(-T - 1)V . + lim - (C(-T, -71)0), = 7^ a.s. 

Because of upper bound (10) and inequality (7), it implies that 

hmi(y^>) / (n,0) =7^1 a.s.. 
n n 

which, because of Equation (12), proves Equation (11). This concludes the induction 
and the proof of Proposition 3.5. 

3.2.2 Left products 

As recalled in the introduction, T. Bousch an J. Mairesse proved that (-^x(n, 0)) neN 
converges almost-surely as soon as the limit of (^y{n, 0)) ragN is deterministic. There- 
fore, the hypotheses of Proposition 3.5 should imply the existence of the cycle time. 
But the theorem in [5, Theorem 6.18] assumes a reinforced integrability assumption, 
that is not necessary for our proof. We will prove the following proposition in this 
section: 
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Proposition 3.6. Let (A(n)) n€N be an ergodic sequence of random matrices with values 
in M^ax sucn that the positive part of maxjj Aij (0) is integrable and that satisfies the 
three hypotheses of Proposition 3. 5. 

If Hypothesis 1. is strengthened by demanding that (0)0 is integrable, then the 
sequence (^x(n, 0)) n£N converges almost-surely and its limit is given by Equation (3). 

To deduce the results on x(n, 0) from those on y(n, 0), we introduce the following 
theorem-definition, which is a special case of J.-M. Vincent [18, Theorem 1] and directly 
follows from Kingman's theorem: 

Theorem-Definition 3.7 (J.-M. Vincent [18]). If (A(n)) neZ is a stationary and er- 
godic sequence of random matrices with values in 1^ and almost-surely at least one 
finite entry on each row such that ^4(0)0 is integrable, then there are two real numbers 
j(A) and jb(A) such that 

lim — maxijfn, 0) = — max?/j(n, 0) = j(A) a.s. 

n n i n i 

lim — min Xi(n, 0) = — miny^ («,()) — 7b (A) a.s. 

n n i n i 

It implies the following corollary, which makes the link between the results on (y(n, 0)) 
and those on (x(n,0)) neN when all 7^ are equal, that is when 7(A) = jb(A). 

Corollary 3.8. If(A(n)) neIi is a stationary and ergodic sequence of random matrices 
with values in an d almost-surely at least one finite entry on each row such that 

A(0)0 is integrable then 

lim —x(n, 0) = ^(A)\ if and only if lim —y(n, 0) — 7(^)1. 

n n n n 

Let us go back to the proof of the general result on (x(n, 0)) neN . Because of 
Proposition 3.2 and Proposition 3.4 and the definition of Lyapunov exponents, we 
already have, for every s.c.c c of G{A), 

lim sup —x c (n, 0) < 7^1 a.s. 

n n 

Therefore it is sufficient to show that liminf„ -^x c (n, 0) > 7M1 a.s. and even that 

lim-x {c} (n,0) = 7 [c] l. 

n n 

Because of corollary 3.8, it is equivalent to lim„ ^y^(n,0) — 7^1. Since all s.c.c of 
Q(A^) are s.c.c of Q{A) and have the same Lyapunov exponent j( c \ it follows from 
the result on the y(n, 0) applied to A^ . 

3.3 Independent case 

In this section, we prove Theorem 2.4. 

Because of Theorem 2.3, it is sufficient to show that, if, for every s.c.c c, 
almost-surely has at least one finite entry on each row, then the sequence \^-x(n, 0)) 
converges almost-surely. To do this, we will prove that, in this situation, the hypotheses 
of Proposition 3.6 are satisfied. Hypothesis 1. is exactly Hypothesis 1. of Theorem 2.4 
and Hypotheses 2. and 3. respectively follow from the next lemma and theorem. 
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Definition 3.9. For every matrix A 6 tj^, the pattern matrix A is defined by 
Aij = — oo if Aij = — oo and Aij = otherwise. 

For every matrix A,B G P^lxi we nave = ^-S- 

Lemma 3.10. Let (-A(n)) ngN be a stationary sequence of random matrices with values 
in RJJiax an d almost- surely at least one finite entry on each row. Let us assume that 
there exists a partition (I, J) of [1, • • • , d] such that A = A satisfy Equation (8), with 
G(B) strongly connected. For every i £ I, let us define 

A, := {Vn G N, (.8(1, n)D(n + l)0), i = -co} . 

1. If lu G Ai, then we have Vra G N, 3i n G /(S(l,n))^ ^ — oo. 

2. If the set £ = Im G {0, -co} dxd P ( A(l,n) = A/) > o| is a semigroup, and if 
P (D = (-co) /xJ ) < 1, £/ien /or every i <E I , we have P(A t ) = 0. 

Proof. 

1. For every w e we prove our result by induction on n. 

Since the A(n) almost-surely have at least one finite entry on each row, there 
exists an ii G [l,--- ,d], such that A^il) ^ — oo. Since (D(l)0) i — -co, every 
entry on row i of D(l) is -co, that is ^4^- ( 1 ) = — oo for every j G J, therefore 
i x G I and B Ul (1) = A ih (1) ^ -co. 

Let us assume that the sequence is defined up to rank n. Since A(n + 1) almost- 
surely has at least one finite entry on each row, there exists an i n +i G [1, ■ • • , d], 
such that Ai n i n+1 (n + 1) ^ -co. 

Since lu G Ai, we have: 

-co = (5(1, n)D(n + 1)0). > (B(l, n)) Un + (D(n + 1)0)^ , 
therefore (D(n+ 1)0) t = — oo. 

It means that every entry on row i n of D(n + 1) is -co, that is Ai n j(n + 1) = -co 
for every j G J, therefore i n+ i G / and 

B i n i n+ i (n + 1) = A inin+1 (n + 1) ^ -oo. 

Finally, we have: 

(B(l,n + l)) iin+i > (B(l,n)) iin +B inin+1 (n + l) ± -oo. 

2. As a first step, we want to construct a matrix M G £ such that 

Mi G I,3j G J, Mij = 0. 

Since P (D = (-oo) /xJ ) < 1, there are a G /, [3 G J and M° G £ with M° = 0. 
For any i G /, since 5(P) is strongly connected, there is M G £ such that M E £ 
and M iQ = 0. Therefore M i = MM is in £ and satisfies M?g = 0. 

Now let us assume / = {a\, • • • , a m } and define by induction the finite sequence 
of matrices P k . 

• P 1 = M ai 

• If there exists ? G J such that P* „■ = 0, then P fe+1 = P fc . Else, since 
the matrices have at least one finite entry on each row, there is an i G /, 
such that P* ki , and P k+1 = P k M\ 
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It is easily checked that such P satisfy, 

Vl<k,3jG J,p* u =o. 

Therefore, we set M — P m and denote by p the smallest integer such that 
P (1(1, p) =M\ > 

Now, it follows from the definition of £ and the ergodicity of (A(n)) n( - N that 

there is almost surely an N G TV, such that A(N + 1, N + p) — M . 

On Ai, that would define a random j'jv G J such that Mi N j N = 0, where ijv is 
defined according to the first point of the lemma. Then, we would have 

(A(l,N + p)) ijN > (A(l,N)) iiN + (A(N + l,N + p)) iNjN > -oo 

But is defined as the event on which there is never a path from i to J, so that 
we should have Vro £ N, Vj <E J, n))y = — oo. 

Finally, A% is included in the negligible set jvn G N, A(n + 1, n + p) ^ M j. 

□ 

Theorem 3.11. If (A(n)) ngN is a sequence of i.i.d. random matrices with values in 
RJnax such that the positive part o/max,jj4,j(0) is integrable, A(0) almost- surely has 
at least one finite entry on each row and Q (A) is strongly connected, then we have 

G [l,d],lim- yi (n,0) = j(A) 
n n 



This theorem is stated by D. Hong in the unpublished [14], but the proof is rather 
difficult to understand and it is unclear if it holds when ^4(1) takes infinitely many 
values. Building on [5], we now give a short proof of this result. 

Proof. According to [5, Theorem 6.7], („y(^>0)) neN converges a.s. We have to show 
that its limit is deterministic. 

The sequence R(n) := A(— 1, —n) is a Markov chain with states space is 

{M G {0,-oo} dxd |M0 = 0} 

and whose transitions are defined by: 

P (R(n + 1) = F\R(n) =E)=¥ (eA(1) = Fj . 

For every i, j £ /, we have Rij(n) — if and only if (A(— 1, —n))^ ^ — oo. 

Let i be any integer in {1, • • • , d} and E be a recurrent state of (i?(n)) ngN . There 
exists a j G [1, • • • , d] such that = 0. Since Q(A) is strongly connected, there exists 
apeN, such that (B(—l, —p))^ ^ — oo with positive probability. Let G be such that 

P ((B(-l, -p))^ ^ -oo, B(-l, -p) = G^j > 0. Now, F = EG is a state of the chain, 
reachable from state E and such that Fa = 0. Since E is recurrent, so is F and E and 
F belong to the same recurrence class. 

Let £ be a set with exactly one matrix F in each recurrence class, such that Fa =0. 
Let S n be the n th time (i?(m)) mgN is in £ . 

Since the Markov chain has finitely many states and £ intersects every recurrence 
class, S n is almost-surely finite, and even integrable. Moreover, the S n +i — S n are 
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i.i.d. (we set 5*0 = 0) and so are the A(— S n — 1, — S n +i)- Since P(Si > k) decreases 
exponentially fast, A(—l,— Si)0 is integrable and thus the sequence (j^y(S n , 0)) ngN 
converges a.s. Let us denote its limit by I. 

Let us denote by T$ the cr-algebra generated by the random matrices A{— S n — 
1, — S n -\-i). Then I is T§ measurable, and the independence of the A(—S n — 1, — S n +i) 
means that (f2, Tq, P, 8 Sl ) is an ergodic measurable dynamical system. Because of the 
choice of Si, we have k > l t o 9 Sl , so that li is deterministic. 

Now, let us notice that the limit of ~2/,(n,0) is that of ij-yi(S n ,0), that is g^j, 
which is deterministic. 

This means that \\m—yi(n,0) is deterministic for any i, and, according to Theo- 
rem 2.3, it implies that it is equal to j(A). □ 
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